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We present measurements of single-qubit gate errors for a superconducting qubit. Results from 
quantum process tomography and randomized benchmarking are compared with gate errors obtained 
from a double vr pulse experiment. Randomized benchmarking reveals a minimum average gate error 
of 1.1 ± 0.3% and a simple exponential dependence of fidelity on the number of gates. It shows that 
the limits on gate fidelity are primarily imposed by qubit decoherence, in agreement with theory. 
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The success of any computational architecture depends 
on the ability to perform a large number of gates, and 
gate errors meeting a fault-tolerant threshold. While 
classical computers today perform many operations with- 
out the need for error correction, gate error thresholds for 
quantum error correction are still very stringent, with 
conservative estimates on the order of 10"'' [1, 2]. 

Gate fidelity is the standard measure of agreement be- 
tween an ideal operation and its experimental realiza- 
tion. Beyond the gate fidelity, identifying the nature of 
the dominant errors in a specific architecture is particu- 
larly important for improving performance. While NMR, 
linear optics, and trapped ion systems arc primarily lim- 
ited by systematic errors such as spatial inhomogcneities 
and imperfect calibration [3, 4, 5], for solid-state sys- 
tems decoherence is the limiting factor. The question 
of how to measure gate errors and distinguish between 
various error mechanisms has produced different exper- 
imental metrics for gate fidelity, such as the double tt 
metric employed in superconducting qubits [6], process 
tomography as demonstrated in trapped ions, NMR, and 
superconducting systems [3, 4, 5, 7], and randomized 
benchmarking, as performed in trapped ions and NMR 
[8, 9]. 

Here we present measurements of single-qubit gate fi- 
delities where the three metrics mentioned above are 
implemented in a circuit QED system [10, 11] with a 
transmon qubit [12]. We compare the results for the 
different metrics and discuss their respective advantages 
and disadvantages. We find single-qubit gate errors at 
the 1^2% level consistently among all metrics. These 
low gate errors reflect recent improvements in coherence 
times [13, 14], systematic microwave pulse calibration, 
and accurate determination of gate errors despite lim- 
ited measurement fidelity. In circuit QED, measurement 
fidelity can be as high as 70%, though in this experiment 
it is ~5%, as readout is not optimized. The magnitude 
of errors and their dependence on pulse length are con- 



sistent with the theoretical limits imposed by qubit re- 
laxation and the presence of higher qubit energy levels, 
with only small contributions from calibration errors. 

We first discuss the double tt metric (tt-tt). Here, two 
TT pulses are applied in succession, which ideally should 
correspond to the identity operation 1. The aim of tt- 
TT is to determine the deviations from 1 by measuring 
the residual population of the excited state following the 
pulses. Despite its simplicity, this metric captures the 
effects of qubit relaxation and the existence of levels be- 
yond a two-level Hilbert space. However, in general, it 
is merely a rough estimate of the actual gate fidelity as 
it does not contain information about all possible errors. 
In particular, errors that affect only eigenstates of ax or 
CTy and deviations of the rotation angle from tt are not 
well captured by this measure. 

A second metric that, in principle, completely reveals 
the nature of all deviations from the ideal gate opera- 
tion is quantum process tomography (QPT) [16]. Ide- 
ally, QPT makes it possible to associate deviations with 
specific error sources, such as decoherence effects or non- 
ideal gate pulse calibration. However, in systems with 
imperfect measurement, it is difficult to assign the results 
from QPT to a single gate error. Moreover, the number 
of measurements that are necessary for QPT scales ex- 
ponentially with the number of qubits. 

While QPT provides information about a single gate, 
randomized benchmarking (RB) [8, 17] gives a measure 
of the accumulated error over a long sequence of gates. 
This metric hypothesizes that with a sequence of ran- 
domly chosen Clifford group generators = g±i<yuTT/4^ 
u = x,y) the noise can behave as a depolarizing channel, 
such that an average gate fidelity can be obtained. In 
contrast to both tt-tt and QPT, RB is approximately in- 
dependent of errors in the state preparation and measure- 
ment. Also, while the other metrics measure a single op- 
eration and extrapolate the performance of a real quan- 
tum computation, RB tests the concatenation of many 
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FIG. 1: (a) Excited state qubit population Pi vs. separation 
time tscp between two successive 7r-pulses {a — 2 ns) . The 
data agree well with the simulation (solid line) involving relax- 
ation and decoherence. The inset shows additional data taken 
for < taap < 30 ns. The residual population corresponding 
to the minimal separation is found to be 0.014 ± 0.008 giving 
a single qubit gate error of 0.7 ± 0.4%. (b) Rabi oscillations 
show a visibility of 100.4 ± 1.0%. 

operations (here up to ~ 200), just as would be required 
in a real quantum algorithm. 

The gate error metrics are performed in a circuit QED 
sample consisting of a transmon qubit coupled to a copla- 
nar waveguide resonator [10, 11, 12]. The theory and 
discussion, however, extend generally to all qubit sys- 
tems including ions and spins. The sample fabrica- 
tion and measurement techniques are similar to those 
in Refs. [13, 14, 18]. Experimentally measured parame- 
ters include the qubit-cavity coupling strength given by 
go/n = 94.4 MHz, the resonator frequency uj^jl-K = 6.92 
GHz, photon decay rate of «;/27r = 300 kHz, and qubit 
charging energy Ec/'2,n = 340 MHz. The qubit is de- 
tuned from its flux sweet spot by 1.5 GHz with a res- 
onant frequency of a;oi/27r = 5.96 GHz, and coherence 
times of Ti = 2.2 /xs and T:^ = 1.3 

In analogy to the NMR language, our single-qubit op- 
erations are rotations about the x— , y— , and z— axes of 
the Bloch sphere [19]. Rotations about any axis in the 
x-y plane are performed using microwave pulses. The 
carrier frequency is resonant with the qubit transition 
frequency and the pulse amplitudes and phases define the 
rotation angle and axis orientation, respectively. In all 
experiments, the pulse-shape is Gaussian with standard 
deviation a between 1 and 12ns. The pulses are trun- 
cated at 2(7 on each side and a constant buffer time of 
8 ns is inserted after each pulse to ensure complete sep- 
aration of the pulses. Using tune-up sequences similar 
to those used in NMR [20], each pulse amplitude is cali- 
brated by repeated application of the pulse and matching 



the measurement outcome to theory. (See supplementary 
material for details.) 

Double TT. — After calibration, we perform the tt-tt ex- 
periments with (T = 2 ns and varying separation time tgep 
between the two tt gates. Subsequently, the excited state 
probability Pi is measured, as shown in Fig. 1(a). Due to 
the decay of the excited state following the first tt pulse. 
Pi increases as a function of isep- This can be accurately 
captured in simulations with a simple theoretical model 
consisting of the dynamics from a master equation for 
a driven three-level atom subject to relaxation and de- 
phasing, with corresponding time-scales Ti and T^. The 
coherent evolution is governed by the Hamiltonian 

H = hY, [^oj'rjaj + Ej (t) (a] + (t, )] , (1) 

where aj = \j — l){j\ is the lowering operator for the 
multi- level atom with eigenenergies hujj. The corre- 
sponding transition energies are denoted hiOij — h^ujj — 
LUi). Drive strength and pulse-shapes are determined by 

5? 

= i^it) cos{ojdt) + Y{t) sin(c^rft)] . (2) 

Here, gj ^ Vjgo is the transmon coupling strength [12], 
LUd/^T^ is the frequency of the drive, and X{t) and Y{t) 
are the pulse envelopes in the two quadratures. 

The inset of Fig. 1(a) shows the experiment with tgop 
varying between ns and 30 ns repeated 2.5 x 10^ times. 
We measure Pi = 0.014 ± 0.008 at t^op = ns. Dividing 
this probability by two as in Ref. [6] gives a single gate 
error of 0.7 ±0.4%. 

Gonceptually, the tt-tt measure is similar to the visi- 
bility measure used by Wallraff et aim Ref. [21], corre- 
sponding to (1 — (cr2))/2 after a single tt pulse. Fig. 1(b) 
shows Rabi oscillations made by increasing the length of 
a pulse resonant with the qubit transition frequency. The 
visibility is found to be 100.4 ± 1.0%. This also agrees 
with our simple theoretical model taking into account the 
Ti, T2, and third-level at our specific operating point. 

Quantum Process Tomography. — The idea behind 
QPT is to determine the completely positive map £, 
which represents the process acting on an arbitrary input 
state p. The theory is detailed in Refs. [16, 22] and can be 
summarized as follows. Any process for a d dimensional 
system (for 1 qubit d = 2) can be written as 

^ip)^ X! XmnBmpB]^ (3) 
m.n— 

where are operators which form a basis in the 

space oi d X d matrices, and x is the process matrix. 
To determine we prepare d^ linearly independent in- 
put states {p™}- For every input state, the output state 
= f (pjf) is determined by state tomography. The 



3 



Rex 



Imx 



(a) 
1 



(b) 



0.5 1 



(C) 

i?,(^/2)o.5\ 





FIG. 2: (color online) Real and imaginary parts of the exper- 
imentally obtained process matrix x for the three processes 
(a) 1, (b) RxiTr/2), and (c) Ry {tt/2) for cr = 2ns. 



process matrix is then obtained by inverting Eq. (3). 
However, in general this last step does not guarantee a 
completely positive map. To remedy this, we use a max- 
imum likelihood estimation based on Ref. [4], which is 
detailed in the supplementary material. 

We perform QPT on the three processes 1, Rx{tt/2) 
and Ry (7^/2) using the four linearly independent input 
states |0), |1), (|0) +i|l))/\/2, and (|0) - |l))/\/2. The re- 
sults of this procedure are shown in Fig. 2. Here, bar plots 
of the real and imaginary parts of x s^i'c shown for a pulse 
with (T = 2ns in the Pauli basis {Bn} = {t,(Tx,(Ty,az}- 
We can compare our data to the ideal process matri- 
ces Xidcai- For instance, for the 1 process, we expect 
Xtt ^ 1 ^^"^ Xuu' = otherwise, which is in good agree- 
ment with the measured results. Small deviations from 
Xideai arisc from preparation and measurement errors, 
gate over- rot at ions, decoherence processes, qubit anhar- 
monicity, etc. Calibration errors of the pulses in the x 
axis are seen as a non-zero Imjxjj^^ } and a drive detun- 
ing error is exhibited in Imjxji^g. }• 

From the experimentally obtained process matrix x 
and its ideal counterpart Xidoai we can directly calculate 
the process fidelity, Fp = Tr[xidoaix]j ^^id the gate fi- 
delity Fg = J d^p{'tlj\W£ {1(^)11 Here the integral uses 
the uniform measure dip on the state space, normalized 
such that J dtp = 1. Fg can be understood as how close £ 
comes to the implementation of the unitary U when aver- 
aged over all possible input states \ip). From Ref. [23, 24], 
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FIG. 3: Gate error vs. total pulse length obtained from 
quantum process tomography plotted for the three processes 
a,i?47r/2),7?,(V2). 



there is a simple relationship between the Fp and Fg, 
namely Fg = {dFp + 1)/(1 + d). For the three processes 
displayed in Fig. 2, Fp is 0.96, 0.95, and 0.95 ±0.01. 

Figure 3 shows Fg as a function of pulse length. The 
error bars are standard deviations obtained by repeating 
the maximum-likelihood estimation for input values cho- 
sen from a distribution with mean and variance given by 
measurement. The missing increase of gate error with 
pulse length is currently not well understood and may be 
partly due to errors in the measurement and preparation. 

Randomized Benchmarking. — The RB protocol, de- 
scribed in Knill et al. [8], consists of the following: (1) 
initialize the system in the ground state, (2) apply a se- 
quence of randomly chosen pulses in the pattern J| - CiPi 
where Ci are Clifford group generators e^*°'"'^/*, with 
u = x,y, and Pi are Pauli rotations, i.e. U, ax, Oy, Uz, (3) 
apply a final Clifford or Pauli pulse to return to one of the 
eigenstates of cr^ , (4) perform repeated measurements of 
Uz , and compare to theory to obtain the sequence fidelity. 

We choose the number of randomizations, sequences, 
and sequence lengths exactly as in Ref. [8] with the 
longest sequences consisting of 196 pulses. All 544 fi- 
nal pulse sequences are applied for 250,000 measurements 
each, taking a total time of about an hour. 

The average fidelity is an exponentially decaying func- 
tion with respect to the number of gates. Fig. 4(a) plots 
the fidelity as a function of the number of computational 
gates for all randomized sequences with a = 3 ns. An av- 
erage error per gate of 0.011 ± 0.003 is obtained by av- 
eraging over all the randomizations and fitting to the 
exponential decay. The excellent fit to a single exponen- 
tial indicates a constant error per gate, consistent with 
uncorrelated random gate errors due to Ti, T^, and no 
other mechanisms significantly affecting repeated appli- 
cation of single-qubit gates. The reduction of the error 
by a factor of ^1/3 from QPT is likely due to the over- 
estimation of errors in QPT where gate errors cannot be 
isolated from measurement and preparation errors. 

The benchmarking protocol is repeated for different 
pulse widths cr, and the average error per gate is ex- 
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FIG. 4: (color online) (a) Average fidelity vs. number of ap- 
plied computational gates. Computational gates consist of a 
randomized Pauli with a randomized Clifford generator. For 
(7 of 3 ns we obtain an average gate error of 1.1%. (b) Aver- 
age error per gate (experimental and theoretical) at different 
pulse widths. The rise for a < 2ns corresponds to the onset 
of limitation by the third level of the transmon. The increase 
in error per gate for a > 2 ns is due to the limitation by 
relaxation. 



tracted, plotted versus total gate length, and compared 
to theory in Fig. 4(b). At large gate lengths, experimental 
results agree well with theory. In this regime, errors are 
dominated by relaxation and dephasing. At small gate 
lengths, the gate fidelity is limited by the finite anhar- 
monicity and the resulting occupation of the third level. 
We obtain error bars from standard deviations in error 
per gate having generated fidelity values from distribu- 
tions with means and variance obtained from the experi- 
ment and theory. The optimal gate length is found to be 
20 ns, as shown in Fig. 4(b). 

Conclusions. — We have systematically investigated 
gate errors in a circuit QED system by measuring gate 
fidelity using the tt-tt metric, quantum process tomog- 
raphy, and randomized benchmarking. Table I summa- 
rizes our results and displays consistently low gate errors 
across all metrics. From comparison with theory, we con- 
clude that the observed magnitude of errors fully agrees 
with the limitations imposed by qubit decoherence and 
finite anharmonicity. Specifically, in the Ti limited case 
and for moderate gate lengths tg, we find that the gate 
error scales as ~ tg/Ti. Once coherence times of super- 



conducting qubits and pulse-shaping are improved, the 
aforementioned metrics will be useful tools for character- 
izing gate fidelities as they approach the fault-tolerant 
threshold. Randomized benchmarking will be a particu- 
larly attractive option for multi-qubit systems due to its 
favorable scaling properties as compared to QPT. 
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Metric 



Measured error in % 



TT-TT 0.7 ± 0.4 

Process tomography: 1 2.4 ±1.1 

Process tomography: Rx{n/2) 2.6 ± 0.8 

Process tomography: Ry{n/2) 2.2 ± 0.7 

Randomized benchmarking 1.1 ± 0.3 

TABLE I: Gate errors for the three metrics used in this work. 
The measurements show consistently low gate errors of the 
order of 1^2%. 
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MICROWAVE PULSE-SHAPING AND 
CONCATENATION 

Fig. SI (a) shows a measured single microwave qubit 
control pulse as used in our experiments. The Gaussian 
pulse envelopes are generated with a 10-bit Tektronix 
AWG520 arbitrary waveform generator with 1 ns resolu- 
tion. The pulse shapes are mixed with sine and cosine 
waves at the qubit transition frequency of 5.95 GHz using 
an Agilent E8267 Vector Signal generator. It is thus pos- 
sible to produce pulses phase-shifted by 90° for qubit ro- 
tations around x and y. Rotations about the z-axis were 
performed with a rotation of the reference frame with 
an accompanying delay equivalent to the x and y pulses, 
see Ref. [1]. For example, the sequence i?a;(7r)i?z(7r)i?y(7r) 
becomes Rx{Tr)tRy{—TT). 

The inclusion of the relatively long buffer time of 8 ns 
at the end of each pulse is to ensure that a single mi- 
crowave pulse is completely turned off before the next one 
is apphed. With sequences of up to ~200 concatenated 
pulses in the randomized benchmarking experiments, 
avoiding residual pulse overlap becomes very important. 
Fig. S 1(b) is a sample sequence for randomized bench- 
marking measured on a fast-sampling scope, and cor- 
responds to applying Ry{-K)Ry{—-n /2)R,{—-n)Rx{'K 

Ry{-TT/2)R,i7T)R,{7T)Ry{-Tr). 



QUBIT PULSE CALIBRATION 

In order to obtain the best gate fidelity, accurate 
pulse amplitude calibration is necessary. We perform 
some tune-up schemes similar to those used in NMR 
experiments [2], which involve applying repeated pulses 
such that small errors can be built up. The rotations 
i?^(±7r/2), i?y(±7r/2), i?^(±7r), i?y(±7r) are ah cali- 
brated independently. 

For the tt/2 rotation around the x-axis, we apply se- 
quences consisting of an odd number n of the pulses, 
[i?a;(7r/2)]", and subsequently measure (cTz). Performing 
this for several n, we calibrate the amplitude by compar- 
ing the measured values with the ideal outcomes obtained 
from a simple two-level simulation including decoherence. 
The other tt/2 pulses are then calibrated similarly. 
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FIG. SI: (a) Measured single microwave qubit control pulse, 
(b) Sample randomized benchmarking sequence. Pulses in 
black (grey) correspond to rotations in the y{x)-axis 



Once all 7r/2 pulses are calibrated, the tt pulses are cal- 
ibrated with a slightly different scheme. To calibrate a tt 
pulse around the a;-axis, we first apply a single calibrated 
Rx{tt/2) pulse followed by an integer number m of the 
TT pulses, Rx{tt /2)[Rx{tt)\™' . Again, the measured values 
of ((T^) for different m are compared with simulation to 
calibrate the amplitude of the Rx{t^) pulse. Note that 
the TT pulse calibration contains a prepended tt/2 pulse 
in order to render the scheme first-order sensitive to de- 
viations in the amplitude. The scheme is then repeated 
for the other tt pulses as well. 



QPT PULSE SEQUENCES AND MAXIMUM 
LIKELIHOOD ESTIMATION 



In all the QPT experiments, the measurements are 
performed after sequences of three concatenated pulses 
are applied to the qubit. The first pulse, chosen from 
{1, i?:r(7r), i?x(7r/2), i?.y(7r/2)}, prepares the four linearly 
independent input states |0),|1),(|0) + i\l))/\/2, and 
(|0) — |l))/-\/2, whose projectors span the space of 2 x 2 
density matrices p. The second pulse corresponds to the 
investigated process chosen from, {1, Rx{tt/2), i?y (7r/2)}. 
A final pulse {{t, Rx (tt), Rx {tt/2), Ry {tt/2)}) rotates the 
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measurement axis to perform state tomography on the 
state resulting from the first two pulses. 

The state tomography data allows us to construct the 
process £{p)^ which can be written as [3] 



(1) 



where Xmn is known as the process matrix and is defined 
with respect to an operator basis, which we take as the 
Pauh basis {B„} ^ {l,ax,cry,crz}- By definition the x 
matrix must be Hermitian and due to the completeness 
constraint must satisfy [3] 
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Although the process matrix x can be obtained by 
simply inverting the £{p) determined from the measure- 
ments, there is no guarantee that errors in the measure- 
ment will lead to a process matrix which is completely 
positive and hence physical. A maximum likelihood esti- 
mation similar to that presented in Ref. [4] can be used. 
Here, we write the process matrix in a Cholesky decom- 
position of the form 



X 



(3) 



where T is a lower triangular matrix parametrized by the 
vector t. This ensures that x be Hermitian. Next, the 
measured data is fit to a physical state by minimizing the 



lab- ^ Xmn'7r[MbB,n\(f>a){(f>a\Bl] 



m,n— 



function 

m = E 

a, 6=1 

'(4) 

Here, ruab is the measured data for the case where the 
state \(f)a) was prepared and the observable Mb was mea- 
sured. A Lagrange multiplier is then used to impose the 
completeness condition [Eq. (2)], such that we find the 
minimum of the function 



d^ 

m - E 

a,fc=l 

+ AE 



at - ^ XmnTr[Mhi3m|(/)a)(0a|i?,t] 
m,n=0 

X„mTr[B,„SfcSt] _ Xr[Bfe] 



m.n— 



(5) 



to obtain the most probable completely positive x matrix 
corresponding to the measured values. 
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